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(54) Sample and hold dock synthesis 



:(57)^r-:;;A mstnodang apparatuscf c^ 



sampling is dsdosed by creating sanr^^ 
signals from CCD imager outputs ttiat are in phase with 
the CCD imager outputs conprising: providing an 
image sensor having an analog output; sensing the out- 
put of the image sensor via system electronics; identify- 
ing and extracting portions of a reset signal within the 
analog output signal; and nxxlifying existing clocks in 
response to extracted portions of the reset signal. 
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Description 
Field of Invention 

Tlie invention relates generally to the field of imag- 
ing devices, and more particularly to the synthesis of 
sample and hold clocks used in correlated double sam- 
pling circuits. 

Background Of The Invention 

Semiconductor t)ased imaging has become pre- 
dominate for conversion of pictorial information into 
electronic dale. Typically, charge coupled devices. 
CMOS based imagers, and other semiconductor t>ased 
imagers are used in camcorders, still electronic cam- 
eras, fax machines, paper and film scanners. 

The output of the semiconductor Imager is an ana- 
log signal with four distinct "zones" of Information. 
These zones, illustrated in Fig. 1 , are characterized as 
reset, back porch, transition and video. The analog out- 
^putof a semirarSuctoi^imagerr requires a sanpleia^^^ 



hoW circuit to extract a more accurate representation of^ 
the video signal. Typically the sample and hokj circuit is 
applied to the analog output of the semicorxjuctor 

iniageri^betoreafij^an^og^^^^^ 

performed. In th^e jarc uite th e analo g output of thg^ 
semiconductor imager is the input to the sample and 
hold circuit This signal is labeled Vjn in Rg. 1 and dis- 
plays the format of the video signal received from the 
image sensor. Sample and hold techniques that are 
applied digitally exist within the prior art. Such a teach- 
ing exists within U.S. Patent 5,086,344 issued to D'Luna 
et al, which is commonly assigned with present inven- 
tion. However, Ixjth analog and digital teachings within 
the prior art discuss voltage level adjustments rather 
than phase adjustment. 

In most systems two sample and holds are used; 
one to clamp the track porch" (Voh) and a second to 
sample the video (Vsjg). These signals are subtracted to 
derive a more accurate video signal in what is often 
called Correlated Double Sampling (CDS). A larger 
magnitude difference indicates that more light has l>een 
detected. 

A reset signal is used by the output stage of the 
imager to dump the charge associated with the previous 
output This reset signal © capacitively coipled to the 
video output and typically leaves an artifact in the form 
of a positive pulse. For a CCD this pulse would be on 
the order of 100-600mV (V^t)- The rising edge of this 
pulse terminates the current output and the falling edge 
starts the next output. 

Current art uses a single timing generator to create 
the reset, clamp and sample signals with the coned 
phase relationship to the analog video signal. There are 
timing requirements for minimum sample to reset 
delays, and reset to clamp delays. The system toler- 
ance is typically added to these delays to guarantee that 
these requirements are met. This cumulative timing 



requirement typically results in a reduction of duty cycle 
for the damp and sample pulses. Smaller pulses make 
it more difficult for the sarnple and hokls to acquire the 
signals. 

5 A typical system would have four separate ICs. If 
the propagation delay through each chip was known, 
the system could be designed to generate the proper 
phase relationship between the CDS pulses and the 
analog video. The problem is that the propagation delay 
10 is not constant t)etween batches of chips, or over time 
and temperature. 

The majority of the timing uncertainty occurs at the 
interfaces between chips. Each chip crossing might 
contrtoute a 5ns uncertainty. For three chip crossings, 
IS this would con-espond to a total of 1 5ns worst case skew 
t>etween the damp sample pulses and the analog video. 
In fast systems the skew may be a signif k;ant portion of 
the total timing budget. At a pixel output rate of 20mhz, 
the sample window (Tsa) would be 50ns/4 or 12.5ns. If 
20 the system skew were 15ns, it wouM be impossit>le to 
txjild the system with the ability to properly adjust the 
^^^^sigr«l delaysin 

-Tapped-analog JK cBgMdetey-^^^^ 



to delay the anabg Vj^ or the digital damp and sample 
26 pulses in the system. However, these delay line based 
-S ystems requirethatvarious.levelsof.calibration.bAper^ 



-fSnn^^ 



^"^TilMtion proc^ woiJd irweaseTT^ 

and would not necessarily adapt to system variations 
30 resulting from temperature fluctuations and the aging 
process of the system. 

If the sample pulse is not in the corred phase with 
the analog Vj^, the sample and hold will acquire the sig- 
nal on a sloping zone of Vjn making the video signal 
35 extremely sensitive to dock jitter. Delay en-ors can 
greatly decrease the signal amplitude and make the 
system non-linear. 

It should be apparent from the foregoing discussion 
that there remains a need in the art for devices and 
40 methods that will apply sample pulses to imager output 
signals in a manner tfiat maintains proper phase rela- 
tionships. This and other shortcomings within the prior 
art are addressed by the teachings of the present inven- 
tion. 

45 

Summ9ry Qf The Invention 

The present invention is directed to overcoming one 
or more of the prot»lems set forth atx)ve. Briefly summa- 
50 rized, according to one aspect of the present invention, 
by identifying the artifact of the reset signal from the out- 
put of the semiconductor imager, Vjn, which is input into 
a correlated double sampling unit, CDS. it is possible to 
CTeate sample and clamp dock signals that have the 
55 ideal phase relationship to Vjn. The identified reset 
pulse is then used to synthesize the CDS docks or to 
modify existing CDS docks. 

By implementing this reset signal identification and 
CDS dock generation on the same integrated drcurt, all 
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chip crossings associated with tolerance build up are 
removed. This has the added benefit of reducing by two 
the required number of interface pins between the CDS 
and the timing generator, potentially reducing package 
costs. 5 

These and other aspects, objects, features and 
advantages of the present invention will be more dearly 
understood and appreciated from a review of the follow- 
ing detailed description of the preferred embodiments 
and appended claims, and by reference to the accom- io 
panying drawings. 

Advantageous Effect Of The Invention 

TTie present invention has the following advantages 75 
over the prior art: (1) it minimizes tolerance buildip on 
timing of the CDS clocks which results in easing system 
timing requirements; (2) it reduces the number of pins 
rec^ired to interface the timing generator to CDS by two 
pins; (3) it maximizes the video signal level by general- 20 
ing more accurate CDS clocks which results in higher 

-speed djpKgattonrand (4) ^^^ 

-sanple clocks due to^the minirrtzed skew that ^rp 
vided for by the present invention. 



of identifying the reset pulse 12 from the Vj^ 11 signal 
shown in Fig. 1 . It should be understood that the image 
sensor employed could be a charge coupled device as 
well as a CMOS base image sensor, or any image sen- 
sor having an analog output. There Is reset artifact that 
exists only on the rising edge in the Vjn 1 1 signal. By 
acquiring 1h^ reset artifact It is possible to establish the 
proper phase refationship between the input signal. Vjn 
1 1 , and the sample and hold circuit. A drcuit as shown 
in Rg. 2a, known as a differentiator 21, could be used to 
generate a pulse on this rising edge of the video signal, 
Vjn 1 1 . The output from the image sensor is used as the 
input signal Vj^ 11, and filtered through capacitor, CI, 
and resistor, R1, prior to being input into differentiator 
21 . The difference between the filtered Vjn 1 1 and a ref- 
erence voifage level, Vref 12, is magnified according to 
the parameters of differentiator 21. Capacitor. C2, and 
resistor. R2, provide tiie prop^ biasing for the correct 
feedback from the output of the differentiator 21 to the 
input of the filtered version of Vjn 1 1. This is the most 
preferred method envisioned by the present invention of 
^idenlifylng theiisingjBdge — - — — 
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BRIEF DESCRIPTION OE^TIE DRAWINGS 



^Other Mmpteia^ 
sioned t>y the present invention. Here, a comparator 
coukl be used to compare Vjn to tiie CCD pedestal volt- 
age (VniiXif known, howeverjheped^tal^w 



Fig. 1 is a diagram showing a sample of the wirvlow 
used in timing the video output from a semiconduc- 
tor imager; 30 
Fig. 2a is a diagram of a differentiator as empk>yed 
by the preferred enrtxxjiment; 
Fig. 2b is a diagram of a sample and hold drcuit; 
Fig. 3 is a block diagram of a CCD based imaging 
system with Con^efated Double Sampling; ss 
Fig. 4 is a dagram of a Correlated Doii^le Sarrpling 
clock synthesis system as envisioned by the 
present invention; 

Fig. 5 is a block diagram illustrating the usage of a 
phase lock loop as envisioned by the present inven- 40 
tk>n; and 

Fig. 6 is a diagram of an embodiment similar to that 
of Rg. 5 incorporating clock synthesis features on 
the phase lock loop. 

45 

To facilitate understanding, identical reference 
numerals have been used, where possible, to designate 
identical elements that are comnmn to the figures. 



DETAILED DESCRIPTION OF TIE INVENTION 



50 



It has been discovered that the Reset Pulse within 
a video signal from a semiconductor imager can be 
identified tiirough artifact within tiie video signal and 
used to provide a very @cact phase relationsh'p in sam- 55 
pling and clamping the video signal. 

Refarring to Rg. 1. which is a timing diagram for a 
typical video signal, generally referred to as V|n 1 1 , that 
is output from an image sensor, there are several ways 



ahrays knbwn^ f^Sfe^ 
S the cbn^fitor t^ 

Vciamp were used instead of Vjp, the comparison 
method couM be simplified t>y comparing tiie damping 
voltage Vdamp to tiie known V^f. This woukl only syn- 
thesize the sanple but not the damp pulse. Another 
method would be to take tiie Vj^ level and compare it to 
an offset. Either a fixed voifage or a peak detector witii 
a predetermined voltage removed from ttie peak detec- 
tor as an approximation to V^ff. 

Rg. 3 is a block dfagram of the various operations 
performed in a Correlated Double Sampling (CDS) Sys- 
tem, generally refen-ed to as 30. Here, CCD 32 receives 
incident light and outputs an analog video signal, V;n 1 1 , 
to tiie CDS unit 34. A level shifter 31 will apply proper 
levels of reset and phase shit signal from the timing gen- 
erator 35. The timing generator 35 will also sipply 
danp 21 and sample 22 signals to the CDS unit 34. The 
CDS unit 34 will output tiie corrected video signal to tiie 
analog to digital converters (A/D). It shoukJ be under- 
stood that the CDS 43 couki be performed in digital 
ratiier than analog as shown in Fig. 3. In such a case 
tiiat A/D woukl be performed prior to data reaching the 
CDS 43. It is also envisioned that such an embodiment 
couki be performed with a digital PLL rather than an 
analog PLL 

Refenring now to Fig. 4, which is a diagram of a Cor- 
related Double Sampling dock syntiiesis system, gen- 
erally refenred to as 40, as envisioned by tiie present 
invention. Complete CDS clock syntiiesis 40 can be 
performed by a phase lock loop (PLL) 42 used to multi- 
ply the kjentified reset clock (as discussed above arxj 
generally referred to as sync 43) by a factor of lour or 
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more. Other methods of multiplying the frequency of the 
sync signal are also envisioned. Among these would be 
Fuzzy Logic Controllers as well as various digital tech- 
niques. However the preferred embodiment employs 
phase lock loop technology because it errploys more s 
readily available technology. Since the sync pulse 43 
has a duty cycle of 25%. it may be necessary to divide 
the sync pulse 43 frequency by two using a toggle flip- 
flop to create a 50% duty cycle signal for the PLL 42. 
Employing an analog device such as PLL 42 will typi- w 
pally generate a clock signal which is within 0.5ns of 
t^ing completely in phase with the extracted reset 
clock. The PLL could be implemented in analog (phase 
discriminator and voltage controlled oscillator) or in dig- 
ital using a base clock that has a higher frequency than is 
the reset dock arxl phase resink technique to generate 
pulses that would effectively divide the frequency of the 
reset dock. 

Rg. 5 is a block diagram of a phase lock loop based 
embodiment using off the shelf devices to aeate the 20 
phase lock loop (PLL) 42 as shown in Fig. 4. Hie phase 
lock lGOpi42rtypiiMlly^ 
oscilla4or=0'GO) 5l7^a-phase:discriminator~5^^^ 
caler 53 and a filter 54. The VCO will multiply its input by 
a factor of four, Prescaler 53 will divide the clock 25 
r<^:twed^frnm^the^Vr/)-51^b y^a-factQr-of-fDur.J^ 



be the sample pulse. 

If only dock tuning is to be perfbnned, the unmodi- 
fied darrp and sample pulses are input to the clock gen- 
eration block and the reset pulse is used to delay tfie 
start of the damp pulse and to terminate early the sam- 
ple pulse. This could b>e done by simply performing a 
logical AND of the clamp and sample pulses with the 
inverted reset pulse. 

The sanpling of Vjp to generate the video signal 
may be done using a single sample and hold if the 
added accuracy of CDS Is not required. There are many 
put>lished methods for Implementing sample and holds, 
all of which could be used in this system. Some notable 
styles are open loop, closed loop, PET ^tch and diode 
bridge. 

Other features of the invention are included below. 
The method wherein the step of modifying existing 
docks in response I0 identified portions of the reset sig- 
nal further comprises multiplying the frequency off reset 
dock with a phase lock loop. 

The method wherein the reset signal frequency Is 
divkled hat! to enable the phase k)ck kx)p to k)ck up^ 

-The appar atus where in the synt hesis means further- ^ 
comprises a phase-lock loop that synthesizes a pulse 
train used for generating the synthesized docks. 
_^The_apparatus„wherein Je_ p haseilQpkJpop_ M^ 



divided cl pd<^ isthgijrT^ 

52 along with the occuirencella^^^ 

pulse from the reset identification 41 . The phase dis- 
criminator 52 will properly adjust the phase relationship 
of the divided dock received from the prescaler 53, typ- 
ically such that a risin c edpe of the divided ckx^ will 
ocojr simultahcH^ with that of the identified rest si g- 
nal. RIter 54 integrates the output of the phase discrim- 
inator 52 such that an average value of the output of the 
phase discriminator 52 ^ achieved. The filtered signal is 
then placed within VCO 51 which multiplies the signal 
by four to properly identify the quadrant of the video sig- 
nal, Vjp. input into dock generator 59, as previously dis- 
cussed. In this manner unity is maintained by the phase 
lock loop. Employing off the shelf devices requires a 
separate phase lock loop 42 and dock generator 59. 

Higher Integration is desirat)le for the aforemen- 
tioned reasons, including facilitating higher pixel read- 
out rates. Refemng to Rg. 6, which is a block diagram of 
the system employing the most preferred method of the 
present Invention, that having phase lock loop (PLL), 
indicated by dotted line 142, Integrated within the same 
devk;e as the dock generator. The sample, clamp and 
sync signals are then all generated by the clock genera- 
tor and prescaler unit 153. The remaining units within 
phase lock loop 142 perform the same functions as 
those previously discussed for Fig. 6. 

If complete CDS dock synthesis is to be performed, 
either the sync pulse 43 or the output from the prescaler 

53 is used as to indicate the start of a new pixel. If the 
reset (sync 43) frequency is multiplied by a factor of 4 
(as shown in Rg. 1 ). the first (next) clock wouki be used 
to generate the damp pulse and the third dock would 



-adaptive.- 



The~app^tus~wherein~tfie~pha^ 
employs a Fuzzy logic controller. 
30 The apparatus wherein the synthesis means is 
responsive to a plurality of outputs from the dock gener- 
ator. 

The apparatus wherein the innage sensing device is 
a charge coipled device. 
35 The apparatus wherein the synthesis means is 
responsive to a reset signal. 

The apparatus wherein the synthesis means is 
responsive to a horizontal dock signal. 

The apparatus wherein the means for sampling the 
40 Image-bearing electronic signal further coirprises 
means for performing a correlated dout}le sampling. 

The apparatus wherein the synthesis means fulher 
comprises means for generating a sample clock for 
sampling the image-bearing eledronic signal and a 
45 damping signal for generating a signal Intended to cap- 
lure a portion of the image-bearing electronic signal. 

The apparatus wherein means for sampling the 
image-bearing electronic signal further comprises an 
analog to digital converter. 
50 The apparatus wherein the analog to digital con- 
verter further connprises a convert input that identifies 
portions of the image-bearing electronic signal are to be 
parsed into discrete units under control of a convert 
dock from the synthesis means. 
55 The apparatus further comprising a phase delay 
drcuit within the synthesis means. 

The apparatus further comprising a phase delay 
within tiie phase lock loop. 

The device wherein the timing means further com- 
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prises a phase lock loop. 

The de^e wherein the phase lock loop further 
comprises the output means on a single integrated cir- 
cuit. 6. 

The device wherein the input signal is one of the fol- s 
lowing: a reset signal that is input to the device inde- 
pendently from the video signal; a reset signal that is 7. 
derived from the video signal; or a horizontal clock sig- 
nal that is input to the device independently from the 
video signal. io 

a 

Clalne 



tronic signal in response to a sanrpie pulse 
applied to the sannpling circuit 

The apparatus of claim 5 wherein the synthesis 
means is responsive to the image-bearing signal. 

The apparatus of claim 5 wherein the synthesis 
means is responsive to a ck)ck which is generated 
t>y the image sensing device. 

An integrated circuit device for generating control 
signals for a video signal comprising: 



1 . A method of creating sampled and clamped signals 
from CCD imager outputs that are in phase with the 
CCD imager outputs comprising the steps of: 

, providing an image sensor having an analog 
output; 

sensing the output of the image sensor; 
identifying portions of a reset ^gnal wthjn the 



ou^Hitiand^ 



modifying exisHrig clocks in response to identi- 
fied portions of the reset signal. 
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an identification circuit for selecting a predeter- 
mined portion of the video signal in response to 
an input signal; 

timing means for providing synchronization 
between a selected portion of the input signal 
and the predetermined portion of the video sig- 
nal; 

output means lor generating a conrected video 
signal in response to the timing meansj.^^ ~ 



^%^(hjg-me thod:pf:^^^ 



The device of claim 8 wherein the output means fur- 
ther comprises a correlated double sampling unit. 



fuilheivcomp rtsesidentif yinq^the resets 
edge on the output and extracting a portion of the 
reset that coincides with a pulse generated at a pre- 
determined point along the rising edge. 

The method of claim 1 wherein the identifying step 
further comprises identifying the reset from by com- 
paring the output with a predetermined voltage 
value and extracting a phase relationship of the 
reset signal relating to tiie output. 

The method of daim 1 further comprising the step 
of indicating a start of a new pixel with the extracting 
portion of the reset signal. 

A system for generating an electronic version of an 
image compri^ng: 



=1 0.-The device of claim 8 further comprising^ 
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the timing means including a phase look loop 
with the capability of synchronizing phase 
between the input signal and a dock generated 
on kx>ard the phase kx)k loop, and synthesis 
means for generating a plurality of syntliesized 
clocks to be employed for a sampling circuit 
within the output means, the synthesized 
clocks being at least partially decoupled from a 
dock generator off the device used in generat- 
ing tiie video. 



an image sensing device capable of converting 
light into an image4)earing signal representa- 
tive of light incident ipon the image sensing 
device, the image sensing device including a 
clock niechanism for transfering tiie image- 
bearing signal representative of light inddent 
upon the image sensing device uy^on applica- 
tion of a clock stimuli; 

a dock generator for applying the clock stimuli 
to the image sensing device; 
synthesis means for generating a plurality of 
synttiesized docks to be employed for a sam- 
pling drcuft. the synthesized clocks being par- 
tially decoupled from the clock generator; and 
means for sampling the image-bearing elec- 
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